Optimal population transfers in a quantum system for 

large transfer time 

Symeon Grivopoulos Bassam Bamieh 

symeon@engr.ucsb.edu bamieh@engr.ucsb.edu 

February 1, 2008 



Department of Mechanical and Environmental Engineering 
University of California, Santa Barbara, CA 93106-5070 

Abstract 

Transferring the state of a quantum system to a given distribution 
of populations is an important problem with applications to Quantum 
Chemistry and Atomic Physics. In this work we consider exact population 
transfers that minimize the norm of the control which is typically the 
amplitude of an electromagnetic field. This problem is analytically and 
numerically challenging. Except for few exactly solvable cases, there is no 
general understanding of the nature of optimal controls and trajectories. 
We find that by examining the limit of large transfer times, we can uncover 
such general properties. In particular, for transfer times large with respect 
to the time scale of the free dynamics of the quantum system, the optimal 
control is a sum of components, each being a Bohr frequency sinusoid 
modulated by a slow amplitude, i.e. a profile that changes considerably 
only on the scale of the transfer time. Moreover, we show that the optimal 
trajectory follows a "mean" evolution modulated by the fast free dynamics 
of the system. The calculation of the "mean" optimal trajectory and the 
slow control profiles is done via an "averaged" two-point boundary value 
problem which we derive and which is much easier to solve than the one 
expressing the necessary conditions for optimality of the original optimal 
transfer problem. 



1 Introduction 

Steering a quantum system from its initial state to a given final state or a set 
of final states is one of the central problems in the control of such systems. 
While transfers to specific final states are very important for applications to 
Quantum Computing and Quantum Chemistry, transfers to given final popu- 
lations are also important for many applications to Quantum Chemistry and 
Atomic Physics. Optimal Control is a natural approach to transfer problems: 
Frequently, one desires to optimize some aspect of the transfer. For example. 
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minimize the transfer time QIE], maximize some measure of efficiency of the 
control in achieving its objective [3] or minimize some measure of the size of 
the control, for instance its Li^ norm ^ El El [7]. Moreover, the optimal con- 
trols), singled out of all possible controls that achieve the objective, should 
have interesting properties tied to the structure of the given system. 

In this work we consider exact population transfers that minimize the 
norm of the control. We work in the semiclassical approximation, where the 
control field influencing the quantum system is taken to be a classical source. We 
also employ the dipole moment approximation, valid for long wavelength fields, 
where the spatial features of the system-control field interaction are lumped in 
an interaction Hamiltonian and the amplitude of the field becomes the control 
parameter. The dynamics of the system is given then by the time-dependent 
Schrodinger equation (we consider a system with one control - which is usually 
the case - and set hio 1): 



and drives an initial state ipQ of system ([^l to a target population distribution 
{|?Ai(T)p — Pi, i — l,...,iV} {N is the dimension of the system and ^jj = 

■01 Si) where the e^'s are the orthonormal eigenvectors of Hq). This cost has 
been used extensively in the literature of optimal control of quantum systems. 
It provides a measure of the energy spent to create the controlling field and 
leads, as we will see, to interesting conclusions. 

Relatively little work has been done on this problem. Analytically, it is a 
hard problem and explicit solutions are known only in few cases: In |2 Ej this 
is done for transfers between eigenstates in a two-dimensional system with two 
controls and in [SI Ej it is done for transfers between eigenstates of a three- 
dimensional system with four controls. In fact, both cases mentioned above are 
instances of a certain algebraic structure being present (the so-called K + P 
structure) [SlIHjj that allows one to find analytic expressions for the control and 
the state in terms of the unknown initial costate but the analytic determination 
of this unknown initial costate (and hence the complete solution of the prob- 
lem) is possible only for systems of small dimensionality because one needs to 
analytically compute matrix exponentials and solve transcendental equations. 
In any event, this structure is special and will not be present in general. In 
another case U (for a two-state system with one control), it is possible to find 
an analytic expression for the control (in terms of unknown constants) but not 
for the state and so the problem has to be solved numerically from that point 
on. For higher dimensional systems, no general properties of the optimal control 
and state trajectory are known. 

Numerically, the two-point boundary value problem that expresses the neces- 
sary conditions of optimality becomes increasingly harder to solve as the dimen- 
sion of the system or the transfer time grows. Dimension growth dramatically 



i^/j = {Ho + Vu{t))ip. 
We wish to find a m e L'^{[0,T]), that minimizes 



(1) 
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increases the computational cost of the numerical solution. More relevant to 
our work is the issue of large transfer time. In many typical applications, the 
transfer time may be a few orders of magnitude larger than the time scale of 
the free evolution of the system. This may be necessary for the transfer to be 
possible or for the amplitude of the control to be within experimentally feasible 
limits. The problem here is the presence of two time scales in the solution, i.e. 
stiffness: There is the fast time scale of the free dynamics of the quantum sys- 
tem and the slow time scale of the transition (which is of the order of T) . This 
creates the need for a very detailed numerical solution in order to guarantee 
good solution accuracy resulting in large computational times. In applications 
one usually considers relaxations of this optimal transfer problem where one 
abandons the requirement for exact transfers and tries to minimize a combina- 
tion of the integral cost (j^J and a measure of distance from the desired final 
state or population distribution such as 

a / u'{t)dt +y^{\^p,{T)\'-p,)\ (3) 

(a > 0). An advantage of optimal transfer problems like these over the one 
we are considering in this work is that they lead to two-point boundary value 
problems with separated boundary conditions and are amenable to iterative 
solution methods, see for example [HI 1101 ITT] . Yet, the above remarks hold for 
these as well. We shall comment on the connections between this work and the 
later type of optimal transfer problems in section 

We found that the study of optimal population transfers for large transfer 
times offers some insight into the nature of optimal control and state trajectory 
as well as computational advantages in the numerical solution of the problem. 
The main conclusions of our work are the following: 

1. For generic population transfers and large enough transfer times, the op- 
timal control has the following, physically plausible form: It is a sum of 
sinusoids with frequencies equal to the Bohr frequencies of the quantum 
system multiplied by slowly varying profiles, that is functions of ^: 

UoAt) = ^tr(e^^o*ye-^°*i(|))+0(ij) 

L is an anti-Hermitian matrix with zeros on the diagonal, whose entries 
are the profiles. This form is explicitly verified in all analytically solvable 
cases (where, because of the structure of the systems, there are no O(^) 
corrections) and it is in fact observed in numerical solutions. 

2. Again for generic population transfers and large enough transfer times, 
the optimal trajectories follow a slow "mean" evolution upon which small 
deviations are imposed. The slow mean evolution and the slow control 
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profiles can be calculated by solving an "averaged" two-point boundary 
value problem (the term will be explained in section|31) in the fixed interval 
[0, 1], irrespective of how large the transfer time T is. The small deviations 
of the optimal trajectories from their mean evolution are due to the free 
dynamics. Quantitatively, 

where ■(/i denotes the "mean trajectory" and the oscillatory e"'^"* term 
is responsible for the deviations from the mean evolution. There are also 
additional corrections, of higher order in a ^ expansion. 

Although these results hold for large transfer times, one may use a solution of 
the optimal control problem obtained this way for a large transfer time T as the 
first step in a continuation method solution of the original optimization problem 
where the continuation parameter is the transfer time. The point is that the 
large transfer time limit both reveals the structure of the controls and serves 
as a good starting point for the solution of the problem: Indeed, the associated 
"averaged" two-point boundary value problem in [0, 1] is much easier to solve 
numerically than the original problem. 

Our presentation is organized as follows: In section|21 we set up the optimal 
population transfer problem for a finite dimensional quantum system, review 
approaches to its solution and comment on the difficulties associated with these 
approaches. In sectional we consider the quantum system with a certain class 
of controls and show how, for large transfer times T, it is approximated to first 
order in a ^ perturbation expansion by an "averaged" control system. Then, we 
set up an optimal population transfer problem for this averaged system. Section 

01 contains our main result, namely that, for large transfer time, the solution to 
the original optimal control problem is approximated by the solution of the 
optimal population transfer problem for the averaged system. This implies that 
the optimal control for the original problem belongs to the class of controls 
used to transform the original system to the averaged one and this provides 
a useful characterization of it. The proof of this result is contained in section 
El We demonstrate our approach with some examples in sectional Sectional 
concludes. 

2 Optimal population transfers 

In this section we derive the necessary conditions of optimality for the optimal 
population transfer problem described in section ^ We consider a quantum 
system influenced by an external, classical source (for example the electric field 
of a laser). For simplicity, we consider a system with one control (which is 
usually the case) and set ft to 1 in Schrodinger's equation: 
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Nevertheless, everything we do in this and the following sections can readily be 
generalized to systems with more controls. 

Before we consider the optimal control problem, we want to address the 
controllability question for this system. The system is controllable if, for 
every pair of initial and target states (V'Oi V'd) there exists a transfer time T 
and a measurable u{t), t S [0, T], such that the solution of Q with u{t) and 
■(/'(O) = e*"^" ijjQ results into ip{T) = e*'^'' V'd, for some (po, fd & S^. (In Quantum 
Mechanics all states are defined modulo a total phase. From it is obvious 
that one may always set (po = 0, for example.) Sufficiency conditions for control- 
lability ^1 El based on the classical results ^| El E| ■ In this work, 
we would like to assume a somewhat strong form of controllability assumption 
as given, for example, in 13 . To state it, we need a few simple notions: A 
quantum system whose energy levels (eigenvalues of Hq) are all different from 
each other is called non-degenerate. Moreover, a system such that no two Bohr 
frequencies (differences of energy levels) are the same, is said to have no degen- 
erate transitions. The connectivity graph Qm of a Hermitian matrix M = (Mij) 
is defined as the pair {Mm^Cm)^ where Mm = {1, ■ • • , N} is the set of nodes and 
Cm — {(*, j), i > j, \Mij ^ 0} is the set of edges joining the nodes. The graph 
Gm is called connected when there exists a path joining every two nodes. 

Controllability assumption: The system Q is non-degenerate, has no de- 
generate transitions and the graph of V is connected. 

Then O is controllable. As a matter of fact, this is the generic situation 
for controllability of 

We now proceed with the set up of the optimal control problem. We wish 
to find a u e L^([0,T]), that minimizes 



and drives an initial state ipo of system to a target population distribution 
{|?Ai(T)p = Pi, i = 1, . . . , N} {N is the dimension of the system). We will refer 
to this as optimal transfer problem (I). The Maximum Principle of optimal 
control 1?, "19' provides necessary conditions for optimality in terms of the 
Hamiltonian function 



where A € C" is the co-state vector. It is shown in Appendix A that solutions 
of the optimal control problem satisfy, X*{t) %p{t) = 0. 

The optimal control u and the corresponding state and co-state satisfy the 
equations 





- i\* {Ho + Vu)ip + iip* {Ho + Vu)X, 





5 



which, given the expression for H, have the form 



iip 
iX 



u 



{Ha + Vu)\ 



(4) 
(5) 
(6) 



For convenience, we rewrite equations l@J and (jSJ using u from 



Hoi; + i (A*yV - iJ*VX) FV, 
HoX + i{X*Vil;~tlj*VX)VX. 



(7) 
(8) 



To these equations one must append the boundary conditions 



m^i'o, \MT)\^^P^, Ini(^*(r)A,(T)) = 0, 



(9) 



y i — 1, . . . , TV. The last of these equations are the transversahty conditions 
at the endpoint. Their proof is also given in Appendix A. We will refer to the 
two-point boundary value problem comprised of equations Q - (0) as two-point 
boundary value problem (I). 

We briefly discuss now methods for its solution. Analytically, we may 
proceed as follows: Define the traceless, anti-Hermitian matrix A by A := 
ip X* — Xip* and using Q and jSJ we can show that 



from IHJl. If wc solve IjlUI) analytically, we obtain an expression for the control 
function u(t) in terms of unknown constants (these unknown constants are ma- 
trix elements of A(0) = ip{0) A*(0) - A(0) V'*(0) and A(0) is what we are after). 
Then, one may attempt to solve ^ and 101 using this expression for u and 
determine these constants by satisfying the boundary conditions 0. In prac- 
tice this program seems impossible to carry out in its entirety except for the few 
special cases mentioned in the introduction. ^ Numerically, one may attempt to 
solve the two-point boundary value problem 10 - ® using, for example, some 
shooting or finite-difference method. This works for systems of small dimension- 
ality and small transfer times but becomes increasingly harder as the system 
dimension grows and as larger transfer times are required for the transfer to be 
possible. As mentioned in the introduction, in many typical applications the 
transfer time has to be a few orders of magnitude larger than the time scale of 

^In all these works, and in fact in most of the literature of Geometric Control Theory, 
authors look at the "lifting" of the system ihip = {Hq + VaUa{t))'4> to SU{N), ihU = 
( Ho+'}2a ^aUa (t) ) U where the state transition matrix U (t) is defined by ip{t) = U (t) '0(0). It 
turns out that the formulation of the optimal control problem in the two setups is similar and 
in fact, equation 1101 in that context is the co-state equation "pulled-back" on the cotangent 
space at the identity of SU{N), see jTfllTsl . 



A 



i[Ho + V M, A] = [-iHo + tr{VA) V, A] 



(10) 



where we substituted 



u = i (A*yV - ^*VX) = i tr{VA), 
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the free dynamics of the system in order to achieve the desired transfer. Be- 
cause the free dynamics of the system is oscillatory, the first terms on the right 
sides of equations {Tf and ||SJ| create small oscillations of the populations around 
their "mean" evolution towards their final values. This creates the need for a 
very detailed numerical solution in order to guarantee good solution accuracy. 
Examples of this can be seen in the graphs of section |H1 Besides the usual 
unfavorable scaling of the solution efficiency with dimension (an issue which 
we do not address), this is the main source of difficulty of the problem. Note 
that these remarks are quite general and independent of the specific numerical 
methods used to solve the two-point boundary value problem. We will see in 
the following how this problem can be overcome. 

Before we leave this section we would like to point out that our discussion 
so far, as well as in the following, will only concern normal extrema of the 
optimization problem (I). Abnormal extrema [201 El will not be considered. 
The reason is that the form of the abnormal extrema does not depend on the 
exact cost used in the minimization problem, and thus, the same abnormal 
extremum can be a local or even a global minimizer to many different cost 
functionals. In this sense, abnormal minimizers are not particular to one optimal 
control problem and don't reflect its particular structure. So, in this work, all 
the discussion and results concern normal minima of problem (I) (as well as 
problem (II) to be defined in the next section). 

3 Optimal population transfers for an averaged 
system 

In this section, we introduce a special form for the control in equation a 
sum of sinusoids with frequencies equal to the Bohr frequencies of the quantum 
system multiplied by slowly varying profiles, that is functions of y. We then 
proceed to "average out" the dynamics in the time scale of the free evolution 
of the system (this time scale is set by the Bohr frequencies), which is fast 
compared to the transfer time T. This leaves us with an "averaged" control 
system whose evolution approximates that of the original under the special 
form of the control introduced. The motivation for this lies in the following: 
We set up a corresponding optimal transfer problem for the averaged system, 
whose cost approximates the cost Q. We will show in section |31 how solutions 
to this optimal transfer problem approximate solutions to our original optimal 
transfer problem (I), to first order in an O(^) expansion, proving the results 
described in the introduction. We begin with the change of variable 



in (Q. In Physics, this is referred to as "transforming to the Interaction Picture" . 
The time evolution of the new variable x is due entirely to the control, because 
the free evolution has been accounted for. In terms of the new variable, 
becomes 



(11) 



ix ^ u F{t)x, 



(12) 
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where, 

F{t):^e'"'>'Ve''"'>K (13) 
Note the appearance of the Bohr frequencies in the matrix elements of F, 

We adopt the foUowing form for the control u{t): 

N 

=e(uo(eO + ^e'"'^*Uj,(rt)), (14) 

where u*^ — Uij and uq is real, so that u is real. Uji is a complex "envelope" 
that multiplies a sinusoid with frequency equal to the Bohr frequency for the 
transition i to j. The value of e will be given shortly. We introduce u(t) from 
ifTIjl in lO and rewrite H12|l in component form: 

a, = e{uoiet) uikiet)) ^e^"-V„x,. (15) 

k^i j 

We approximate (|15|) for small e using averaging. In averaging, one considers 
equations of the form 

w = ef{w, t, e), (16) 

where f must be a bounded function of its arguments with bounded deriva- 
tives up to 2nd order such that the limit 

fay{w) := lim - / f{t',w,0)dt' 

exists. A standard averaging theorem (see Chapter 8 of 1^) guarantees that, 
for sufficiently small e, the solution of 

w = efav{w) 

with an initial condition 0(e) close to the initial condition of 116() (i.e. w(0) — 
w{Q) ~ 0(e)) is 0(e) close to that of for a time interval of length 0(i). 
Equation H15|) involves two time scales, 1 and - but we want to average only 
over the time scale 1 dynamics. This is achieved as follows: Consider, instead 
of H16|) the following equation: 

w — ef{w,t,et,e). (17) 

Define wq = et and substitute wq for et in (|17|l . Then, consider the system 

w = ef{w,t,wo,e), 
Wo = e 

and apply averaging to it. The resulting averaged form of (|17|l is now 
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where 



fav{w,Wa) 



lim — 

r — *oo T 



t+T 



f{w,t',wo,0)dt'. 



We now apply this to equation H15|l . Since the time average of e'"* is zero 
for a; ^ and 1 for lo = 0, only terms with no time dependence will contribute 
to the averaged equation. Letting x be the averaged x, the averaged form of 
l(T^ is 

ixi = e{Vii uo{et) + ^ V^j Uij{et) Xj). (18) 
Taking e = ^ and rescaling time io s — et = (|18(l becomes 



«^ = uo{s) + ^ V^j Mij(s) xj, 



(19) 



or, in vector form, 



. dx 
ds 



V[uo,Uij]x, 



where 



( V\\Uq V12U12 • • • 

V21U21 V22U0 • • • 



V 



ViiUq V12U12 
X = I ^1*2 "12 ^22^0 



By construction, every solution to p9|) with controls uq(^s) and Uij{s) and initial 
state x{0) = "0(0), provides a solution to |^ with u{t) given by H14() and initial 
condition '!/'(0), correct up to 0{e) terms for a time interval of size j- = T. 
It is shown in Appendix B that system (|19|) is controllable on account of the 
controllability assumption on the original system. 

Since our goal is to relate optimal transfers of the original system to optimal 
transfers of the averaged one, we must find an objective for the averaged system 
that approximates I!w|1|2([q yj)- So, we compute ||u|li2QoT]) '"(^) given by 
ifTIjl . with e = y : 



/ u\t)dt = ^ f {uod) + Yl 
Jo 1 Jo 1 



T' 



T' 



k^i 



Uj^{-)ulu{-) \dt 



T' 
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1 |'K(.) + 2^, 



i^j k^i 

where B{T) represents terms bounded in T. This last hne is the resuh of 
separating the integrals into two kinds, these without exponentials, which are 
explicitly retained, and those with, which can easily be seen to scale like ^B{T) 
after a partial integration: Indeed, for any diffcrcntiable /, 



1 



1 



iujT Jq 

= -^{^'^^ /(I) - /(O) - I' e-^' fis) ds}. 

So, we pose the following optimal control problem for the averaged system: Find 
controls uo{s), Uij{s), s e [0,1], that minimize 

/ [E"'j(*)"j^(^) + "o(s)] rfs- / [Y,Kis)f + ulis)]ds (20) 

and drive an initial state x{0) = i/'o of system (|19|l to a target population 
distribution {|a;i(l)p = pi, i = 1,...,N}. We will refer to this as optimal 
transfer problem (II). 

The necessary conditions for optimality are derived from the Hamiltonian 
function 

H{x^,z^,u^j) = + ^ E 1^ ~ iz*V[uo,Uij\ x + ix*V[uo,Uij\ z 

= \ul + ^ - iVjtUj,{xiZ* - ZiX*) - iuo ^ Vu{xiZ* - z,x*) 

and have the form 

«^ = VuUoXi + ^VijU.jXj {i^ = V[uo,Uij]x), (21) 

= V^iUQZi +'^VijUij Zj {i^ = V[uo,Uij]z), (22) 
Uij = iVji {xiZ* - ZiX*), uo = i^^Vii{xiZ* - ZiX*). (23) 
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We rewrite equations H21|l and (|22|l using uq and Uij from (|23|) : 

^ = ^ iVy - ZiX*)xj + ^ Vfcfc(SfeZfc - Zkxl) ViiX,, (24) 

dz 

= ^ \Vij\'^{xiZ* - ZiX*) Zj + ^ Vfcfc(x/cZfe - Zkxl) ViiZi. (25) 

The corresponding boundary conditions are given by 

x(0) = Vo, |a;.(l)|2=p„ Ini(x*(l)z,(l)) = 0. (26) 

We will refer to the two-point boundary value problem comprised of equations 
H24I) - (I26|l as two-point boundary value problem (II). From H23I) . we see that 
all Uij with Vij — are identically zero, as they should. We can also show that 
Uo = and simplify the right sides of equations 124|) and H25|l : In a fashion 
similar to the construction of A in section|2 we define Lhy L :— xz* — zx* . We 
also define another anti-Hcrmitian matrix K ~ K{x, z) = K{L) by, 

K,, ll/yfLy = |y,,f (x,z*-z,5;*), i ^ j, (27) 

Ku := Vu ^ VkkLkk = Vu ^ Vkk{xkzl -Zkxl). (28) 
fe fe 

K is the analog of —iHq + tr(yA) V in section ^ and is a linear function of L. 
With this definition, H24I) and (|25|l read simply as 

g = X(£)x, (29) 

It is easy to see that L satisfies the differential equation 

^ = [X(L),L]. (31) 

The M-th component of this equation reads 
dLj 



— Kjj Lji LijKj 



and so, 



3 

— KiiLii -f ^ ^ KijLji — LiiKii — ^ ^ LijKji 

= ^ I I ^ (iy -Z^ji — Lij Lji ) = 0, 



L,,(s) = L,,(l) = -2ilm(5:(l) z,(l)) = 0. (32) 
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This shows that Kii{s) — Lii{s) = and uo{s) = and so, equations (|24|) and 
1)25(1 simphfy to 

^ = ^IVijl'^i^i^j - (33) 
5 = 5]|F,,f(x.z;-z,x*)z-,. (34) 

We wiU refer to this set of equations (along with ((26)1 ) as two-point boundary 
value problem (II) as well. 



4 Main Results 

In this section, we make the connection between solutions of the two-point 
boundary value problems (II) and (I) in the large T limit. 

Theorem 1: Let {x{s), z{s)) be a solution of two-point boundary value problem 
(II) over [0, 1]. Define ipit), X{t) and u{t), t e [0,r], by 

(35) 
(36) 

l^F,,e--*L,,(A). (37) 

kl 

Then, for large enough T, ip{t) satisfies the necessary conditions of optimality 
(@J - (jnj, up to terms of order O(^) and \{t) and u{t) up to terms of order 

o(^)- 

Thus, solutions of the two-point boundary value problem (II) provide approx- 
imate solutions to the two-point boundary value problem (I) for large transfer 
times T. A natural question to ask then is, whether these approximate solutions 
to two-point boundary value problem (I) are in fact approximations to solutions 
of (I), in the large T limit. This is answered positively by the following theorem: 

Theorem 2: Let i/'o and {pi}i=i,...,Ar be an initial state and a target popula- 
tion of system J^l, respectively, and let {x{s), z{s)) be a solution of two-point 
boundary value problem (II) over [0, 1]. Then, for almost all pairs (■i/'Oj {Pi})^ a 
solution of two-point boundary value problem (I) exists, for large enough T, of 
the form 

i^(t) = e-^"*x(|) + 0(i), (38) 
A(i) = ^e-^"'''z{^) + 0{^), (39) 



m = e-^"^>'x{-), 

m = ^e-^"*^-(|), 

u{t) = ltr(e^^«*ye-^«*L(i))^ 
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The corresponding control has the form 

<t) = ltr(e^^o*ye-^°*i(|))+0(^) 

= ^T.^kie^-''^'L,,{^) + Oi^). (40) 

kl 

The set of pairs {ipo,{pi}) of initial states and target populations for which 
a solution of two-point boundary value problem (II) provides a solution of (I) 
according to H38|l and (|39|l is open and full measure in the corresponding product 
manifold. 

According to this theorem, solutions to the two-point boundary value prob- 
lem (II) approximate solutions to (I), for large transfer times, in the sense of 
equations (|38|l - (|4(J|I . for almost every population transfer. In other words, all 
the local minima of optimal transfer problem (II) approximate local minima for 
the optimal transfer problem (I) according to H38|l - H4U|) . The question arises 
naturally: Are all local minima of optimal transfer problem (I), for large T, 
approximated in the sense of equations H38|l - H4()|l by local minima of (II)? The 
answer to this question is essentially yes (see comment after theorem 3). We 
state the following theorem: 

Theorem 3: Let -00 and {pi}i=i,...,Af be an initial state and a target population 
of system (Q), respectively. Then, for almost all pairs {ipo,{pi}) and for large 
enough T, the globally optimal solution to the optimal transfer problem (I) is 
approximated by the globally optimal solution of (II) according to theorem 2. 
As before, the set of pairs {ipo,{Pi}) of initial states and target populations 
for which this happens is open and full measure in the corresponding product 
manifold. 

In fact, we prove that, for large enough T, a number of the lowest energy 
optima of (I) that depends (in an unknown way) on T, are approximated by the 
corresponding lowest energy optima of (II) according to theorem 2. We think 
though, that theorem 3 is enough to demonstrate the spirit of our approach. 

Theorem 3 precisely states the main results of our work that were delineated 
in the introduction: We obtain useful, physically plausible properties of the 
optimal control and state trajectory and at the same time, we reduce the solution 
of the original optimal control problem to a much easier problem: Indeed, the 
evolution equations H33() and H34(l of two-point boundary value problem (II) 
do not contain the free dynamics of the system and thus their solution (which 
describes the "mean" evolution of the state) is much easier, see sectional 
We end this section with two remarks: 

1. Theorems 2 and 3 are proven for an open, full measure set of pairs 
(ipo, {Pi}) of initial states and target populations. Unfortunately, the very 
important case of the initial state TpQ being an eigenstate (or, in general, 
having some populations equal to 0) is excluded. The reason is that in 
this case, two-point boundary value problem (II) has non-isolated solu- 
tions. Although this property is necessary for our proof of these results, 
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we believe that they can be extended to (at least some) transfers with 
non-isolated solutions. Nevertheless, theorem (I) which contains all the 
essential applicable aspects of this work still holds. 

2. An interesting implication of the theorem above is that, for large T, the lo- 
cally optimal values of the objective ("energy") scale hke ^. This demon- 
strates that the quadratic objective we use, cannot correspond to a phys- 
ical notion of energy. It could be that an objective like 

/ Ht)\dt, 
Jo 

would be more appropriate for that purpose in the context of 

5 Proof of Main Results 
Proof of Theorem 1 

To begin, we define a new costate variable by A :— TX and rewrite IJj) and ((H)) 
in terms of A: 

iiP = Ho^l; + ^{X*Vil;-i^*V~X)Vil;, (41) 
iX = Ho~X+ ^{X*V^p-ij*VX)VX. (42) 
Note that the form of the boundary conditions remains unchanged, as well: 

^(0) = Vo, \MT)\^^P^, MV'HT) A, (r)) = 0. (43) 

We must show that e"*^"* x(y) and e~*^"* z(y) satisfy (glj - ESJ up to terms 
of order O(^). To this purpose, we perform one more change of variables in 
(El) - (EJ): 

y = e^^^V, I = e'"°'X. 

In terms of the new state and costate, the necessary conditions of optimality 
take the form 

iy = L{i*F{t)y-y*Fmmy, (44) 
li = ^{l*F{t)y^y*FmF{i)l, (45) 
where, as before, F{t) = e*^"* Fe"*^"*^ along with 

y(0) = Vo, \y^{T)\^=p^, lm{y*{T)k{T)) = Q. (46) 

The boundary conditions retain their form because |?/i(T)p = \i})i{T)\'^ and, 
li{T) and yi{T) are rotated by the same amount, e~'^^''^ , with respect to ipi{T) 
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and Xi{T). We will refer to equations H44I) - (|46|l as two-point boundary value 
problem (!'). The equivalence of problems (I) and (!') is evident. 

Now, we have to show that a;(y) and z{^) satisfy - up to terms 
of order O(^). To do this, we average equations iBH) and To make the 

procedure more transparent, we rewrite equations l|44|l and (|45|) in component 
form: 



k 



km j 



km, j 

One can see (based on our controllability assumption) that we get non-zero 
contributions from two groups of terms: Terms with ujkm 7^ and ^ 
such that m = i and k = j, and terms with ujkm — ^ij = 0, i.e. k = m and 
i = j ■ Letting y and I be the averaged y and /, the averaged state and co-state 
equations are: 

To finish the proof, we rescale time in equations (|47|l and (|48|l to s = et — 
Letting y{s) :— y{t) and /(s) := these equations read now: 

j^i k 

These equations are the same as (|^ and (1^ (with the substitution y ^ x 
and Z ^ z). Then, from the sequence of variable changes and the averaging 
theorem, the conclusion of the theorem follows. ■ 



Proof of Theorem 2 

To prove Theorem 2 we need the following lemma: 

Lemma: Let tpQ and {pi}i=i,...,Ar be an initial state and a target population of 
system respectively, and let {x{s), z{s)) be a solution of two-point boundary 
value problem (II) over [0,1]. The set of pairs {ipo,{pi}) of initial states and 
target populations for which all solutions of two-point boundary value problem 
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(II) are isolated is open and full measure in the corresponding product manifold. 

Proof of Lemma: We begin by introducing new coordinates for the state and 
costate of the optimal transfer problem (II) by 

Xi li e , Zi :— Ji e , (51) 

where 4>i := avgXi mod tt and li :— \xi\ for Imxi > and —{xil 
for Imi; < 0, and similarly for the 6'i's and J^'s. Then, li, Ji G M and 

Oi e [0, tt), Vi = 1, . . . , iV. With this definition, the phases (pi and 9i have 
discontinuities whenever the signs of the imaginary parts of Xi and Zi change. 
We shall see that this will not be a problem for us because 0i and 9i will turn out 
to be constant in time. On the other hand, the introduction of these coordinates 
will prove to be beneficial in the following. 

In the new coordinates, and (|34|l . take the form 

i.h - = -iJ, ^ |F,,f J, e^C.-^.) + z/, e'i^^-'^) J2 iKjf J2, (53) 

while the boundary conditions at the end become 

/2(l)=.p,;, 0,(1)- 0,(1) =0. (54) 

Multiply (|52l) by Ji, H53|l by —li, add them and take the real part. The resulting 
equation reads: 

-0,y= sin(0, - 9,) {If " "^^ ^ iV^jl^lf}- (55) 

Except for the degenerate cases {Ii{s) — 0, Ji{s) — const.) and (Ji(s) = 
0, Ii{s) = const.) Vs G [0,1], which will be excluded, we see that, given the 
transversality conditions at s = 1, this equation implies that 9i{s) = 4>i{s), Vs G 
[0, 1]. Using this fact, we see that the right sides of equations l|5^ and (j5S)l are 
purely imaginary. This leads to the simplified equations 

0,(s) = 0, Hs) = Q. 

We see that the two-point boundary value problem (II) separates nicely into 
two parts: A trivial problem for the arguments of state and costate components 

0,(s) - 0, ^,(s) = 0, (56) 
(/),(0) = </),o, 0,(1) - 0,(1) = 0, (57) 
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which has a unique solution as long as ipoi 7^ 0, Vi = 1, . . . , iV (so that all 4>i{0) 
are unambiguously defined) and a two-point boundary value problem for the 
(signed) magnitudes of state and costate components 

/. = +/, ^|l/,,f/, J, - J, (58) 

im = 7,0, /■(l)=ft. (60) 

We will refer to 158|l - H6()|l as the real form of problem (II). These two-point 
boundary value problems can be seen to be necessary conditions for optimal 
population transfers of the following real control system on S^^^: 



, \V,2\V12 



(61) 



Here the are real controls and (|6HI is controllable on S^~^ because of the 
controllability assumption on the original system, see Appendix B. This separa- 
tion of the two-point boundary value problem (II) into a trivial problem for the 
evolution of the arguments of state and costate components and real two-point 
boundary value problem (II) was inspired by the result of 20], see section 4 of 
that reference. 

We are now ready to prove the lemma. From the discussion so far, it should 
be obvious that we need V'io 7^ and li/ioiP 7^ Pi,Vi = l,...,iV so that the 
(constant) phases of the state components are uniquely defined and certain 
pathological cases mentioned are excluded. The set of pairs {ipo, {pi}) of initial 
states and target populations for which this is the case is open and full measure 
in the corresponding product manifold. 

We define a terminal condition function Q of the initial costate vector J(0) 
of real problem (II) by 

C;(J(0)):=(/2(1)^...,/^(1)T- (62) 

Q is really a function of only TV — 1 components of J(0) because one of them is 
fixed by the condition = x*{0)z{0) = /'^(O)J(O) (let us decide to fix Ji(0)). 
Similarly, once (/2(1)^, . . . , /Ar(l)^) are fixed, so is /i(l)^, and that is why we 
need only N — 1 terminal conditions. In the following, when talking about 
initial costate vectors, we will identify vectors in M^^^ with vectors in 
perpendicular to /q. G has two important properties: First, it is a smooth 
function of its argument. Indeed, the right sides of (|58(l and H59|l are functions 
of / and J so, 22 their solutions depend smoothly on /(O) and J(0). Thus, 
when 7(0) is fixed, the terminal conditions depend smoothly on J(0). Second, 
because of controllability of system H61|) . Q is onto. Since Q is a. mapping 
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between manifolds of the same dimension, it is a diffeomorphism from (open) 
neiE hborhoods of K^-^ to neighborhoods of the — 1 dimensional simplex. 
Sard's theorem implies that the set of critical values of ^ in the N—1 dimensional 
simplex (i.e. the set of points aromid which Q is not a diffeomorphism) is of 
measure zero. 

Any initial costate vector J(0) such that Q{J{Q)) = (pi, . . . ,pn)'^ provides 
a solution to real problem (II). Because of the two properties of G, the set 
of Pi's for which all J(0) that satisfy Q{J{Oj) ~ {pi, . . . ,pn)'^ satisfy also 
A/'(Dt/( J(0))) — 0, is an open set of full measure in S^^^. For a pair of initial 
state and final populations which satisfy this, the set of J(0)'s must be discrete 
and without hmit points, otherwise, JV{DQ{J{0))) ^ for at least one of the 
J(0)'s. This means that, given an initial state with all populations non-zero, the 
set of populations that can be achieved by isolated locally optimal transfers of 
the real problem (II) is open and full measure. So, the set of pairs {tpo, {pi}) of 
initial states and target populations for which all solutions of two-point bound- 
ary value problem (II) are isolated is open and full measure in the corresponding 
product manifold. ■ 

Proof of Theorem 2: We are going to define terminal condition functions for 
two-point boundary value problems (II) and (F) in a way similar to that in the 
proof of the lemma. First, for (II) we define T : R'^^''^ — > M2Ar-2 

Tim) (1^2(1)1, ■ • ■ , 1^^(1)1, Ini(a;*(l)z2(l)), . . . ,Im(a;^(l) zjv(l)))^ (63) 

(Recall that one complex component of z(0) is fixed by x*(0)z(0) = 0. Here, 
we again identify initial costate vectors in C''^ perpendicular to ipo with vec- 
tors in C^-i and also identify C^-^ with R2JV-2)^ 

is a smooth function 

of its argument. Also, any initial costate vector z(0) such that JF(z(0)) = 
{p2, ■ ■ ■ ,Pn, 0, . . . , 0)^ provides a solution to problem (II). 

The corresponding terminal condition function J-'i for problem (F), is defined 
exactly the same way: 

.Fi(/(0);T) := (|2/2(r)p, . . . , |yjv(r)p, Im(y*(T) hiT)), . . . ,Im(y^(r) lNiT)) f 

. . (^^^ 

The second argument of J^j is just a reminder of the transfer time. J^i is also 
a smooth function of its argument. Again, any initial costate vector 7/(0) such 
that ^1(2/(0)) = {p2, ■ ■ ■ ,Pn ,0, ■ ■ ■ , 0)^ provides a solution to problem (F). From 
the proof of theorem (I) , we know that 

J^i{v;T)^T{v)+0{^). (65) 

From this we also have that 

DT,{v;T)^DJ^{v) + 0{^). 

Although JFi is not formally defined for T = 00 from H64I) . we can define it 
from (|65|1 as !Fi{v;0) :— J-{v). With this definition, Ti is continuous in y 
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at = 0, with continuous first derivatives in v and ^ there. In particular, 
DTi{v;oo) = DT{v). 

Consider now an initial costate vector v that solves problem (II), i.e. 

^(v) = {P2, ■ ■ ■ ,PN,0, ■ • • ,0)^ 

We have seen that the set of of pairs {iljQ,{pi}) such that all w's that satisfy 
this are isolated [DJ-{v) full rank), is an open set of full measure in the product 
space. For such a transfer and for large enough T, the implicit function theorem 
guarantees the existence of a 5v such that Ti {v+5v] T) = (p2 , ■ • ■ , PAf , 0, . . . , 0)"^. 
Then, v + 6v provides a solution for problem (F) and "ip^" is a solution for 
problem (I). Taking T large enough so that \5v\ = 0[^), the averaging theorem 
guarantees that this solution (■(/'(i), A(t)) to two-point boundary value problem 
(I) is such that 

m = e-^"*x(|) + 0(i), 

where {x{s), z{s)) is the solution to problem (II) we started with.H 
Proof of Theorem 3 

We only consider transfers such that problem (II) has isolated solutions. Any 
initial costate v that satisfies J-{v) = {p2, ■ ■ ■ ,Pn, 0, . . . , O)"'" provides a solution 
to problem (II) and D!F{v) is full rank. Inside a ball of radius Af > there can 
be only a finite number of these initial costates v because any discrete set with 
no limit points inside a compact set must be finite. 

From equation (|65|) we may conclude that for a given transfer, we can take 
T large enough to bound the difference of J- and Ti over an open ball around 
the origin by any 5 > 0: 

VAf >0, V(5>0, 3T>0suchthat \Ti{v;T) - T{v)\ < S, V |u| < M. 

Thus, the only solutions of J-i{v; T) — {p2, ■ ■ ■ ,Pn, 0, . . . , 0)^ inside the ball of 
radius AI come from perturbing solutions of T{v) = {p2, ■ ■ ■ ,Pn ,0, ■ ■ ■ , 0)^ by 
quantities of order 0(y), for T large enough. In particular, they also form a 
finite set and DJ^i{v;T) is full rank for each such v. We arrive at exactly the 
same conclusion if, instead of a ball, we define a neighborhood of the origin by 
an ellipsoid. 

We introduce now the following quadratic form in w G {w E s.t. ip^w = 

0} ~ C^-l ~ R2A'-2. 
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E is non-negative and, furthermore, due to the connectivity of the graph of V 
(part of the controUabihty assumption) can be shown to be positive definite, see 
Appendix C. Then, the sub-level sets of E define (open) ellipsoids in M.'^^~'^. 
The significance of our choice for E{v) lies in the following: 

is the Hamiltonian function from which the optimal state and costate equations 
and are derived. Thus, is a constant of motion along the optimal 
solutions. Note, also, that H{x,z) = ^i^j l^y Since E is just H evaluated 
at t = 0, we conclude that E is equal to the cost of a trajectory of system (II) 
(equations ^S6l and H34|l ) with initial conditions {'ip{)^v): 

With a calculation similar to that of section O one can show that the locally 
optimal costs for problems (II) and (I/I') coming from the solutions v and 
V = V + O(^), respectively are related as follows: 




1 " 1 

= ^{T.\^^A'\i^O^V* - V,rOj\' + 0[-)). 

Let us fix a value Eq > Q such that the initial costate vq that achieves the 
desired transfer with the minimum energy for problem (II) satisfies 

N 

Then, for large enough T, vq ~ vq + O(^) is the initial costate that achieves 
the desired transfer with the minimum energy for problem (F). This proves the 
assertion of the theorem. In fact, we proved a little bit more: Not only the 
global optimum, but also all local optima of problem (F) with values of energy 
less than , come from local optima of problem (II) according to the theorem 
2, for T large enough (Note that the solutions v of problem (I/F) outside the 
ellipsoid E{v) < Eq have higher costs than those inside the ellipsoid). ■ 

6 Examples 

We consider three examples, each involving a different quantum system: A 
general two-state system with one control, a general three-state system with 
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one control and the Morse oscillator model for the vibrational dynamics of the 
ground electronic state of the OH bond. We restrict our attention to the 22- 
dimensional space of bound states for that model and seek to control populations 
again with one control field. In all of the examples, we consider transfers from 
one eigenstate of the system, to another. Although in the proof of theorems 2 
and 3 we had to exclude such transfers (because in that case two-point boundary 
value problem (II) has continua of solutions parameterized by angles, see H56|l 
and l(S7|l. and we need isolated solutions to prove the theorems), we believe these 
theorems to hold for such transfers as well. Perhaps this can be established using 
different techniques from ours. In any case, theorem 1 still holds and so, every 
solution of two-point boundary value problem (II) will furnish an approximate 
solution to (I). 



A two-state system 

Consider the two-level system i-if) = {Hq + Vu)^^, tp £ C"^, with 

By rescaling u, we make \Vi2\ = 1. We are interested in the "population inver- 
sion" transfer 

V-O = n ) * V'd = 



J ^ " V 1 

In this example, the averaged optimal transfer problem (II) can be solved an- 
alytically. To begin, we introduce the anti-Hermitian matrices L and K{L) of 
section ©: 

L = ( ) and KiD ^ L. 

Then, 1)31(1 implies that £12(5), s e [0, 1], is constant. Equation 1(29(1 reads 

dx _ I Li 
ds \ —LI2 

Its solution with initial condition ^ ^ ^ , is given by 

-f s f cos(|Li2|s) 
""^'^^ V -^jT^\M\Li2\s) 

To achieve a:(l) = ^i* ^ i must have |Li2| = (n -|- ^)tt, with n eN. The 

value of the cost (^0)1 is ^(2n -I- 1)^. Thus, n = corresponds to the global 
minimum of optimal transfer problem (II) . The approximate optimal control for 
problem (I) has the form 1(40(1 

u{t) = sin(cj2it + f), 
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where tp G [0, 27r) comes from the phases of L12 and V12. 

Figure shows the evolution of populations in a two-state system with 
0^21 — 1 under the approximate optimal control, for T = IOtt and T = 67r. Note 
that even for T = Gtt, the averaged equations are still a good approximation to 
the full dynamics. 




Time 



Figure 1: Averaged (dashed line) and exact (full line) populations of the two- 
state system under the approximate optimal control, for T — IOtt and T — Gtt. 



A three-state system 

Let us now consider the general three-state system with one control and 

( El Q Q \ / Vii V12 Vi3 \ 

Ho^ \ E2 and F = V^^ V22 V23 ■ 
\ J V ^13 V23 J 

We assume that W12 = Ei — E2, W13 = Ei — E3 and ^23 — E2 — E3 are all 
different from each other and from zero. Their exact values are unimportant 
for the averaged optimal transfer problem as are the values of Vii, V22 and V33. 
By rescaling the control, we can take \Vi2\ = 1 (we assume \Vi2\ ^ 0). Define 
P ■= 1^23^ and r = |Vi3p. We assume that 1 > p > r > 0, with other cases 
treated similarly. We are interested in the transfer 
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particularly in the way the "two-photon" transition 






assists the "direct" ("one-photon") transition 





In this example, we are able to calculate the form of the (locally) optimal con- 
trols for the averaged problem analytically up to a constant, which has to be 
computed by solving the state evolution equations numerically and imposing 
the terminal conditions on the state. For a special case (p — 1), we can obtain 
everything analytically. We begin again with equation H31|l . ^ = [K{L),L]. 
The diagonal elements of L are zero and L is anti-Hermitian, so it has only 3 
independent (complex) entries, L12, L23 and L13. They satisfy the following 
equations: 



dLi2 
ds 

dL23 

ds 
dLi3 

ds 



= (P- 0^13^23' 

= (r-l)Lt2ii3, 

= (1-^)^12^23. 



Because X2{0) = ^3(0) = 0, we have that ^32(0) = 0. The general solution of 
the above equations with ^32(0) = is 

Li2(s) = 6*=^ Acn(u;s), 
L23(s) = -e"^^^ Bsn(u;s), 
Li3(s) = e*('*"+'*^^')Cdn(ws), 

where w; > 0. cn, sn and dn are Jacobi elliptic functions and 
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kwy/p — r 
kwy/ 1 — r 



C I ^[l-p){l-r){p~r) y w^/T^ 

< fc < 1 is the modulus of the elliptic functions. Now, from a;i(l) — 52(1) = 0, 
we have that ^12(1) — 0. This allows us to determine w as w = (2n -I- l)K{k), 
n € N, where 

Kik) 



vl-fc^ii? 
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the complete elliptic integral of the first kind, is the quarter-period of the func- 
tions en and sn. The only undetermined parameter is k. It can be solved for 
numerically by solving the two-point boundary value problem given by 129|l , 



dx 
ds 



e"^^^ Acn{ws) e'^-'f'^^+'f'^''^ rC dn{ws) 

_g-#i2 ^cn(-u;s) -e*'^^^ sn(w;s) 

_e-*Wi2+fe) rCdn(ws) e-'^'t'^^ pB sn{ws) 



X, 



and the boundary conditions 

5(0) = I I , 5(1) 





It is straightforward to see that the phases (/)i2, (/)23 and <j)i2+(t>23 can be absorbed 
in the phases of the components of a;, so fc is independent of them and depends 
only on p and r. Intuitively, one expects a discrete set of solutions for k. The 
cost of a local minimizer is given by 

J = 2/ [\Ui2{s)\^ + \u23{s)\^ + \ui3{s)\^]ds 

Jo 

= 2/ {A'^cn'^{ws)+rC^dn^{cs)+pB^dn^(cs))ds 
Jo 

2(2n+lfK^(k) 
^ ; V 7 .[[p - r)k^ + r{l - p)]. 



(1 -p){l - r){p - r) 



The expression for the approximate locally optimal controls of optimal transfer 
problem (I) is 



2 f t 

u{t) = ^1 - ^cn(u)— ) sin(w2ii - ai2 + 0i2) + 

^Bsn(ti;^) sin(a;32t - "23 + 023) - 

dn{w-^) sin(w3it - ais -I- 012 -I- 023)|, 



where aij — arg Vij . 

Figures Q and show an approximate locally optimal control, the (slowly- 
varying) profiles of its Bohr frequency components and the averaged and exact 
evolution of the three state system with p — .9 and r — A, under this control 
for T = 207r. Figure in particular, demonstrates the point we discussed in 
the introduction: The 'averaged' two-point boundary value problem is non-stiff 
because the short-time scale natural dynamics of the system has been averaged 
over and thus, its solutions are much easier to compute compared with those of 
the original two-point boundary value problem (I). In Appendix D, the special 
case with p = 1 is analyzed in detail and a complete solution to the optimal 
transfer problem (II) is given for that case. 
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20 40 62.83 

Time 



Figure 3: Averaged (dashed lines) and exact (full lines) populations of the three- 
state system under the approximate optimal control. 
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Bound states of a Morse oscillator 



Our final example considers the 22-dimensional space of bound states of the 
Morse oscillator model for the vibrational dynamics of the ground electronic 
state of the OH molecule. Here we solve the optimal transfer problem (H) 
numerically for two transfers, one from the ground vibrational state (state 1) 
to an intermediate excited vibrational state (state 10) and one from state 10 
to the highest bound state, state 22. Figures (0J and © contain the state 
populations as well as the intensities (absolute values squared) of the frequency 
profiles as functions of rescaled time. Note the correspondence between high 
intensity value for a profile and the transition between states i and j. 
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Figure 4: Average populations and profile intensities vs. 
locally optimal transfer 1 ^ 10. 



(scaled) time for a 



7 Conclusion 

We examined the large transfer time limit of exact, optimal population trans- 
fers in a finite dimensional quantum system. The investigation of this problem 
uncovered useful structure in the optimal control and state trajectory and, more- 
over, resulted in the much simpler optimal control problem (H) whose solution 
provides the first order solution to the original optimal transfer problem, in a ^ 
expansion. The main reason we considered exact population transfers is that in 
this case, the 'average' two-point boundary value problem (H) (equations H24|l - 
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Figure 5: Average populations and profile intensities vs. (scaled) time for a 
locally optimal transfer 10 — > 22. 



H26() ) is independent of the transfer time T of the original problem. This in turn 
allowed us to prove Theorems 2 and 3 which are important for uncovering the 
structure of solutions of optimal transfer problem (I). Moreover, an advantage 
of the optimal transfer problem (I) is that, once one has a solution to the 'aver- 
age' two-point boundary value problem (II) one can derive from it approximate 
solutions to optimal transfer problem (I) for all transfer times T larger than 
some Tq. On the other hand, solving the two-point boundary value problem (II) 
becomes extremely difficult as the dimension of the system grows. For practical 
applications to large-dimensional systems, an optimal transfer problem with an 
objective like © 

a / u\t)dt +Y,{\MT)\'-P^y, 

which leads to separated boundary conditions would be preferable. Although 
an analog of Theorem (I) can be proven in this case too, it doesn't seem so for 
Theorems 2 and 3. Yet, our technique of averaging over the short scale natural 
dynamics of the system would very much improve the efficiency of any method 
used for the solution of these problems, as well. 



27 



Appendix A 



First, we prove the transversality conditions lm{4>*{T) \i{T)) =0, i = 1, . . . , N . 
The optimal transfer problem (I) is a standard Bolza problem with (real) ter- 
minal state constraints, \ipi{T)\'^ = Pi, i — 1, ■ ■ ■ , N . According to the general 
theory of such problems the transversality conditions for the costate at the 
final time are given by 

\ frr\ cl{\^pi{T)\^ - Pi) 

" d^MTf " ^^^*(^)' (66) 

where Vi are the real Lagrange multipliers that enforce the terminal state con- 
straints. The transversality conditions in the form we state them, 

Im(^*(T)A,(T)) = 0, i^l,...,N 

follow easily. 

Next, we prove that X{t)*ip{t) — 0. One can easily show from equations 
(@J and (O that X{t)*ijj{t) is constant along any optimal trajectory and so, 
X{t)*ip{t) = \{T)*ip(T). From the transversality conditions it follows that 
Im(V'*(T) A(r)) = and thus, lm{-)jj* (t) X(t)) = 0. Let us now decompose A 
as follows, X ^ cip + X±, with c real and Ax perpendicular to ip, i.e. X*^^j = 0. 
All we need to show is that c = 0. We introduce this representation of A into 
equation ©. The resulting equation is 

u = i (AlV^V - ^*VXj_) +i{c* - c) i^p*V^), 

and the reality of u forces c to be zero. 



Appendix B 

We prove that system (|19ll is controllable on account of the controllability as- 
sumption on the original system (^). Due to the fact that H19|) has complex 
controls, every non-zero Vij,i ^ j, provides us with two generators of su{N) 
(traceless anti-Hermitian matrices), Eij — Eji and i{Eij + Eji) (Eij denotes a 
matrix with only one non-zero element, at the position (i, j), equal to one. So, 
{,Eij)ki — SikSji. It is easy to see that EijEmn — SjmEin)- One can easily verify 
the following commutation relations: 

E^k-Ek^, i^k, (67) 
i(E,k+Eki), i^k, (68) 
2i{Eu-Ejj). (69) 

Due to the connectivity of the graph of V , there exists a sequence of index pairs 
that connects any state index i with any other state index j. Thus, starting 
with the given generators Eij — Eji and i{Eij + Eji) for all Vij ^ ^ j , we 
can generate, with repeated use of (|67|l and (|68|l . all missing such generators 



[Eij — Eji,Ejk — Ekj] — 
^ij ~ Eji,i{Ejk + Ekj) = 
^ij ~ Eji,i{Eji -\- Eij) — 
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(corresponding to Vij = 0,i ^ j). Finally, using we can generate the 
diagonal generators of su{N) (its Cartan subalgebra). For the system l|HT|l 
which has real controls, every non-zero Vij,i ^ j, provides us with a generator 
of so{N) (anti-symmetric matrices), Eij — Eji. In that case, the repeated use 
of Ht)7|l is enough to establish controllability. 

Appendix C 

Here we show that the quadratic form 

N 

E{v) ^J2 \^.,\'\i;o^v* - v.rojl^ 

in u e {w e s.t. ^o""^ = 0} ~ C^^"'^ ~ M-^^^-^ is positive definite, based on 
the connectivity of the graph of V . The non- negativity of E is obvious. Let 
E{v) — 0, then we have that 

^o^v* - v.roj = 0, V (z, j) s.t. V,j ^ 0. (70) 

Let us assume for a moment that V12 7^ 0. Then (recall, all tpQi ^ 0), 

V2_ _ Vj_ 

V'02 ~ V'oi ' 

It is straightforward to see that the connectivity of the graph of V and the 
repeated use of the relations (fzH)! allows us to show that 

^^^or^,Vz = 2,...,iV. 

VOi ■001 ^01 

Recall now that both ipo and v can be defined modulo global phases which we 
choose such that ipoi and vi are real. Then, 

f = ^,V. = 2,...,7V. 
Vot Vol 

The relation i/jqV — implies then that 

N 

which means that vi ~ and hence v = 0. 

Appendix D 

In the special case p — \, we can give a complete analytic solution to the optimal 
transfer problem (II) for the second example of section |S1 The solution for the 
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matrix elements of L is given by 

Li2{s) = e^"^!^ A cos(ws), 
i23(s) = -e*"*^^ ^ sin(ws), 

1 — r 

where w is determined to be it; = (2n + n G N. To determine A, we have 
to solve the two-point boundary value problem given by (|29|l . 



ds 



_g-i0i2 ^ cos(ii;s) -e^-^-^s ^ sin(ws) | x, 

_e-i(0i2+</>23) ™l e-*'^^^ ^ sin(ws) 



and the boundary conditions 




With the change of variables 

cos(ti;s) sin(ws) \ / Xi 
J/ - I y2 I := I 1 





-sin(ws) cos(ws) / \ e*('^i2+023) 
y satisfies the simpler equation 

^2/ ( ^ A 
ds I w 

\ l-r 

The boundary conditions for x translate into the following conditions for y: 



2/(0) = , y(l 






It is a straightforward calculation to find the solution for y{s) and impose the 
boundary conditions. We find then that A must satisfy the condition 



which implies that 



A = A{m, n) — i (m7r)^ 



{n + l/2y 
(l-r)2 y" (l-r)2 
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where m e N is such that m > -^^j^^. The solution for the state evolution is 
given by 



Xi 

gi{<l>12+<t>23) ^3 



cos((n + |)7rs) sin((n + i)7rs) 
1 

— sin((n + i)7rs) cos((n + i)7rs) 



cos(m7rs) 
^(m,n)2M!2££) 

n + 1/2 ■ / \ 

— sin(m7rsj 



y m(l — r) 



We see that the local minimizcrs for this optimal transfer problem are parame- 
terized in terms of two integers, n G N and to G N such that to > -^^^rpp- The 
cost of such a minimizer can be easily computed to be equal to 

(n + 1/2)2 



J = 277^ [to^ 



1 -r 



The values of to and n and the exact cost for the global minimum are uniquely 
specified by the value of r. 
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